Long-range memory elementary ID cellular automata: Dynamics and nonextensivity 
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We numerically study the dynamics of elementary ID cellular automata (CA), where the binary 
state (Ji{t) G {0,1} of a cell i does not only depend on the states in its local neighborhood at 
time t — 1, but also on the memory of its own past states ai(t — 2),ai{t — 3), ...,ai{t — r), .... We 
assume that the weight of this memory decays proportionally to t~" , with a > (the limit a —> oo 
corresponds to the usual CA) . Since the memory function is summable for a > 1 and nonsummable 
for < a < 1, we expect pronounced changes of the dynamical behavior near a = 1. This is 
precisely what our simulations exhibit, particularly for the time evolution of the Hamming distance 
H of initially close trajectories. We typically expect the asymptotic behavior H(t) oc t^"^~'^' , where 
q is the entropic index associated with nonextensive statistical mechanics. In all cases, the function 
q{a) exhibits a sensible change at a ~ 1. We focuse on the class II rules 61, 99 and 111. For rule 61, 
g = for < a < Qc — 1.3, and q < for a > ac, whereas the opposite behavior is found for rule 
111. For rule 99, the effect of the long-range memory on the spread of damage is quite dramatic. 
These facts point at a rich dynamics intimately linked to the interplay of local lookup rules and the 
range of the memory. Finite size scaling studies varying system size A'' indicate that the range of 
the power- law regime for H{t) typically diverges oc A^ with < z < 1. Similar studies have been 
carried out for other rules, e.g., the famous "universal computer" rule 110. 

PACS numbers: 05.45.-a, 05.65.+b, 89.75.-k 



Cellular Automata (CAs) have a long tradition as mod- 
els of complex, emergent space time dynamics encoded 
in simple, local rules. Originally introduced by von Neu- 
mann as a theroretical framework for self-replication [l| , 
it was realized that they could serve as models for much 
broader classes of phenomena, including even univer- 
sal computation (e.g. in Conway's "game of life" |3])- 
In the context of statistical mechanics, detailed stud- 
ies on the simplest class of CA, elementary ID CA with 
k ^ 2 states and 3-cell neighborhood, where carried out 
in the 1980's. Wolfram [3, 0| developed a qualitative 
classification scheme of the 2^ = 256 elementary CA 
rules (only 88 fundamentally inequivalent) that distin- 
guished four different 'complexity classes' of their dynam- 
ics (class I: fixed-point attractors, class II: space-time pe- 
riodic attractors (limit cyles), class III: aperiodic space- 
time chaos, class IV: 'complex' dynamics (travelling, lo- 
calized aperiodic structures on regular background)). It 
was shown that rule 110, a member of class IV, is a uni- 
versal computer in the Turing sense [5j. Many attempts 
where undertaken to obtain a more quantitative charac- 
terization of CA dynamics, e.g. mean field models \_ _ 
local structure theory [3 , quantification of pre-images 
and relating certain class III rules to low-dimensional de- 
terministic chaos y. The relation between the different 
classes, as well as the connection of these discrete, dy- 
namical systems to other fields in statistical mechanics, 
however, still remained obscure, leaving open the ques- 
tion of whether there might exist a more general theoretic 
framework to describe CA dynamics. Fractal patterns 



and strong spatial and temporal correlations observed in 
CA dynamics for certain rules, as well as the absence of 
a Hamiltonian, seem to suggest a natural connection to 
nonextensive statistical mechanics and the related con- 
cept of g-entropies (with g y^ 1) [ifl, llll ll3| > rather than 
the traditional Boltzmann-Gibbs (BG) framework (i.e., 
the limiting case g = 1). Whereas systems in the BG 
class are characterized by strong sensitivity on initial con- 
ditions with trajectories typically diverging exponentially 
with time (hence strong mixing in phase space, and er- 
godicity), systems with q ^ 1 typically show a weaker 
dependence on initial conditions, e.g. trajectories diverg- 
ing asymptotically as a power of time. Therefore, BG 
systems may be characterized as 'memoryless systems', 
whereas the systems studied in nonextensive statistical 
mechanics often exhibit long-range memory. 

In this paper, we first define a new model by explicitely 
introducing long-range memory. In our model, the bi- 
nary state ai{t) G {0,1} of a cell i does not only de- 
pend on the states in its local neighborhood at time 
t — 1, but also on the memory of its own past states 
ai{t — 2),ai{t — 3), ...,(Ji{t — t), .... We assume that the 
weight of this memory decays proportionally to r~", with 
a > 0. The case a — > cx) corresponds to the usual CA, 
where the states at time t are determined solely by the 
neighbor states at time t — 1. This case is compared 
to the generalized update scheme in Fig. ^ We then 
study its sensitivity to initial conditions. More precisely, 
we determine the a-dependence of the entropic index q 
(sometimes noted g^en in the literature, where sen stands 



for sensitivity). By analogy with what occurs in simple 
dissipative maps at the edge of chaos Il3l. in vanishing 
Lyapunov exponent conservative maps |l4| . and in self- 
organized critical models [l5j, one expects the sensitiv- 
ity to the initial conditions (the Hamming distance in 
the present case) to be asymptotically proportional to 
^1/(1-9) with g < 1. While for some elementary CA, 
e.g. rule 110, long range memory seems to emerge as 
a result of purely local update rules, the way this hap- 
pens (and, why it does not happen for most other rules) 
is poorely understood. Our approach, that contains the 
conventional CA scheme as a limit case, aims at providing 
a generalized framework to address such questions, and 
also relating them to nonextensive statistical mechanical 
concepts. 
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FIG. 1: Left panel: in conventional CA, the state of cell i at 
time t depends only on the states in its local neighborhood at 
time t — 1. Right panel: in a-CA, the state of cell i at time t 
depends on the states of its neighbors at time t — 1 and the 
(infinite) memory Si(t) of its own past states (grey shading 
indicates power-law decay of the weighting of memory states) . 

Model. Consider a ID cellular automata, consisting of 
N cells in a line, with periodic boundary conditions. The 
state space of the system is defined by a £ {1, 0}^. Each 
cell i is updated in parallel according to the following 
update rule: 

'Jr{t) - fWr-l{t - 1), 0(S4i) - 1/2), a, + l{t - 1)], (1) 



where ^i(t) is defined by: 



-(t)=^lim^ 



ai(t 



T = l 



r — 1 



(2) 



with a G [0, cx)). Q{x) is the Heaviside step function, i.e., 
due to the normalization of S e [0, 1], it returns either 
or 1, depending on Sj(i) — 1/2 being smaller or larger 
than zero, respectively. / is one of the well-known 256 
elementary local update rules for neigborhood 3, binary 
CA. However, E!i(i) introduces long-range memory, de- 
caying with a power a of (discrete) system time. Notice 
that for a — > CX), this maps on the conventional ID CA 
without memory. In practice (i.e. simulations), T does 
not go to infinity, but rather is fixed to some large finite 



value (T up to 960). Let us briefly discuss the spirit of 
this approach. While it would be perfectly reasonable 
to choose any other functional form for memory decay 
(e.g., an exponential), for our purposes, the one chosen 
in Eq. (2) appears to be the most sensible: it becomes, 
for arbitrary configurations and T — > cxd, nonsummable 
for < a < 1, hence, we expect a transition from a short- 
range memory phase to a long-range memory phase if we 
approach the critical value Uc from above. Consequently, 
it is the simplest functional form for which we may ex- 
pect a qualitative change in dynamics for a finite value of 
the control parameter a, while keeping the update rule 
/ constant. 
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FIG. 2: Space-time plots starting from random initial config- 
urations of conventional CA, i.e. a -^ oo (left panels), and 
a = 1.2 for rule 61, a — 1 for rule 99 (right panels). States 
ai — are shown yellow, Ui = 1 in red. 

Results. We have carried out extensive numerical sim- 
ulations for many of the 256 elementary CA rules. It 
turns out that class I and class HI CA ususally are very 
insensitive to long range memory, i.e. trajectories of a- 
CAs still converge to fixed points (class I) or cover a 
huge proportion of the state space in a 'chaotic' manner 
(class HI), independent of a. However, quite pronounced 
changes in system dynamics are found for several class 
II and class IV rules. Here, we focuse our discussion on 
three rules that where classified as class II, namely rule 
61, 111 and 99. In the conventional updating scheme, all 
three rules behave very similarly, i.e. their dynamics con- 
verges to space-time periodic, checker-board like patterns 
traveling over the lattice (compare left panels of Fig. 2). 
Near etc ~ 1, however, profound changes in the dynamics 
are observed: due to increased sensitivity towards initial 
conditions, we find complex, fractal spatio-temporal pat- 
terns (perturbations) travelling on a regular background. 
Whereas for small N these perturbations tend to die out 
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FIG. 3: Difference patterns for CA with initial configura- 
tions differing in one randomly chosen bit. Cells with differ- 
ent states in both configurations at time t are shown in red. 
Right panels: a — 1.2 (a = 1) for rule 61 (rule 99). 



after a finite number of updates, for large N they appear 
to be (asymptotically) stable. Similar striking changes 
are found in the time evolution of difference patterns, 
when compared to the coventional update scheme (Fig. 
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FIG. 4: Time dependence of the Hamming distance H{t) for 
rule 111 (filled curves) and rule 61 (dashed curves) for typ- 
ical values of a and N = 1000, ensemble averages over 200 
different initial conditions. All curves approximately follow 
straight lines in the log-log plots for two decades or more, 
indicating power law behavior. Memory size T — 320. 

Let us now systematically study sensitivity towards ini- 
tial conditions. We measured the time evolution of the 
Hamming distance H{t) of initially close trajectories for 
different CA rules and different values of the memory 



parameter a. Typically, we find asymptotic scaling pro- 
portional to a power-law with an exponent 7 that is a 
function of a: 



H{t) oc t'^(") for t > to 



(3) 



where io is small, e.g. in the order of 10 for rule 61 if the 
initial configurations differ in one (randomly chosen) bit. 
Fig. 21 compares H{t) of rules 61 and 111, for different 
values of a. In all four cases shown, we find power-law 
scaling for two decades or more, however, the functional 
dependence of the slope 7(a) is obviously very different 
for both rules. This is also evident in Fig. \E\ whereas 
for rule 61, 7 is very close to unity for all a < a^^ w 1.4 
and shows a steep, step-like transition to 7 « 1/2 for 
a > a^^, rule 111 shows a (nearly) opposite behavior - 
for a > al^^, one has 7 « 1, for a below the critical 
point, a smooth transition to 7(0) « is found. The 
exact value of limQ^o7(a) is, however, still ambiguous, 
as the measured slope in this limit is affected by finite 
size effects of the memory, tending to overestimate 7. In 
simulations in this regime we used memory sizes up to 
T — 960; the smooth decay of 7(a) strongly suggests 
that limQ_to limT-^oo 7(a, T) — 0. 

In nonextensive statistical mechanics, g is a measure 
for the sensitivity of a dynamical system towards varia- 
tion of initial conditions; it is closely related to the diver- 
gence of trajectories in the phase space of the system. In 
case of divergence of trajectories described by a power- 
law ex P, we have the relation 



7 = l/(l-9)<^g=l-l/7. 



(4) 



The functional behavior of q{a) for rules 61 and 111 is 
plotted in Fig. O (left panel). For both rules, we find 
strong deviations from q = 1 (i.e. the exponential di- 
vergence typical of classical BG statistics): in the case of 
rule 61, one finds (7 « for a < a^^ and g w — 1 for larger 
values of a; for rule 111, q is strongly negative below aj^^ 
(with a probable divergence q{a) —^ —00 for a —^ 0), and 
zero for larger a. 
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FIG. 5: The a-dependence of 7 (left) and q (right) for rules 
61 and 111. Memory size T = 320. 

Last, let us look at the critical exponents z{a) that 
describe the divergence of the range of the power-law 
regime with system size oc N^. For rule 111, one finds 
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FIG. 6: Time dependence of the Hamming distance for rule 
61 at different sizes A'^. Left: t and H are rescaled by A'^. The 
collapse of the curves indicates that the range of the power- 
law regime for H{t) diverges with system size N (straight 
dashed line with 7 = 1 shown for eye guidance). Right: For 
a > 1.4 curves collapse without rescaling (straight dashed line 
has slope 7 — 1/2). Memory size T = 320. 



the conventional CA without memory. This may indi- 
cate that the appUcation of these concepts derived from 
nonextensive statistical mechanics could help to refine ex- 
isting CA classification schemes. In particular, complex 
dynamical behavior, as e.g. found for the famous 'uni- 
versal computer rule' 110, depends on a delicate inter- 
play between memory and information spreading, how- 
ever, this is poorly understood for most CA. Our general- 
ized scheme may help to address this interesting reverse 
problem, i.e. the question of how memory emerges for 
certain CA rules, and why it does not for others (we will 
report details elsewhere). 

We acknowledge interesting discussions with J.M. 
Gomez Soto, as well as financial support by SI Inter- 
national and AFRL (USA). 



z = 1 independent from a, whereas for rule 61, one finds 
z{a) w 1 for a < a^^ and z{a) « above a^^ (Fig. 
EJ. This seems to suggest that the transition at ac is 
second-order like for rule 111 and first-order like for rule 
61, which is also confirmed by the step-like discontinuity 
in 7(0;) in the latter case and the smooth descend of this 
quantity below ac in the former case (Fig. [S] right panel) . 
Discussion. We demonstrated that long-range memory 
with weights decaying ex r^" leads to completely unex- 
pected, exciting new dynamical phenomena in elemen- 
tary ID cellular automata. In particular, we showed for 
the three class II rules 61, 99 and 111 that the sensitivity 
towards initial conditions, measured in terms of the di- 
vergence of the Hamming distance between initially close 
configurations H{t) oc t"', and the associated entropic in- 
dex q, shows pronounced transitions at critical values ac 
slightly above one. Interestingly, the behavior of q{a) is 
strikingly different for rules 61 and 111: whereas the for- 
mer shows a step-like transition from q ~ to q — —1 at 
ac with increasing a, the latter has q = above ac and a 
gradual divergence to —00 when alpha approaches zero. 
Let us first comment the fact that the transition takes 
place at Qfc > 1, although the memory function in Eq. 
(2) becomes nonsummable for a < 1; this is probably 
due to two effects: first, the effective dimension of the 
system is slightly larger than one, because not only the 
ID memory strings, but also the local neighborhoods of 
cells are considered; second, there is a non-trivial inter- 
play between the memory and the update rules, leading 
e.g. to considerable fiuctuations of g(a) at ac that appear 
to be conserved even in the limits TV — > cx) and T — > cxd 
(compare Fig. [SJ. However, a more detailed analysis is 
necessary to quantify the influence of both effects. Con- 
sidering the fact that, without long-range memory, both 
rules converge to very similar dynamical attractors (and 
hence were both assigned to class II by Wolfram), these 
striking differences are really a surprise. Remarkably, 
the different behavior wrt q is still conserved in the limit 
of large a, where our new, generalized scheme maps on 
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